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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)^ Responsive to communication(s) filed on 20 November 2007 . 
2a)S This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayie, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-3.5-12 and 15-25 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) E3 Claim(s) 1-3.5-12 and 15-25 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

£))□ The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 !)□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 Certified copies of the priority documents have been received. 

2.D Certified copies of the priority documents have been received in Application No. . 



3.Q Copies of the.certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 

A. This action is in response to the following communications: Amendment filed: 
1 1/20/2007. This action is made Final. 

B. Claims 1-3, 5-12 and 15-25 remain pending. 

C. Specification objection is withdrawn due to amendment. 



Claim Rejections - 35 USC § 103 

1. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. This application currently names joint inventors. In considering 
patentability of the claims under 35 U.S.C. 103(a), the examiner presumes that the 
subject matter of the various claims was commonly owned at the time any inventions 
covered therein were made absent any evidence to the contrary. Applicant is advised 
of the obligation under 37 CFR 1.56 to point out the inventor and invention dates of 
each claim that was not commonly owned at the time a later invention was made in 
order for the examiner to consider the applicability of 35 U.S.C. 103(c) and potential 35 
U.S.C. 102(e), (f) or (g) prior art under 35 U.S.C. 103(a). 
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3. Claims 1-3, 5-12 and 15-25 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Girgensohn et al. (US 7,149,974 B2). Herein referred to as 
Girgensohn. 



As for independent claim 1 . Girgensohn teaches an image processing system for correlating still 

picture data with video data, comprising: a video display section for reproducing and displaying the video 
data on a screen (col. 3, line 44); a picture display section for reproducing and displaying plural pieces of 
still picture data on the screen (figure 1), wherein the plural pieces of still picture data is extracted from 
the video data and displayed in different sizes (figure 4 and col.4, line 49 "reduced representations"); and 
a correlation section for, upon the instruction entered by the user during the reproduction of the video 
data, correlating the designated still picture data with a reproduction time position in the video data (col.3, 
lines 17-25; col.6, lines 4-17 and col.7, lines 10-18). 

However, Girgensohn does not specifically and in detail teach a designation section for accepting, during 
the reproduction of the video data, an instruction from a user to designate one of the plural pieces of still 
picture data displayed on the screen. It would have been obvious to one of ordinary skill in the art at the 
time of the invention to have the user select a one of the plural pieces of still picture data from a video clip 
for representation of said video clip, in view of Girgensohn because Girgensohn suggest that the user is 
in control of the presentation, in such that the user manipulates the display as the user sees fit (col.3, 
lines 39-40). Girgensohn also goes further by explaining the use of still picture data to be used to 
represent video clips and that the still picture data is defined as "keyframes", in such that keyframes are 
selected from the video clips or composites to be representative of the object (video clip). Girgensohn 
provides a few examples of how the keyframes are selected: "keyframes are selected according to a 
variety of criteria. In an embodiment, a keyframe is selected from each video clip or composite. In an 
alternate embodiment, keyframes are selected from the first and last video clips in the sequence." (col.6, 
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lines 18-32) Given the multiple choices of how keyframes are chosen and the fact that the user is a great 
influence over the final presentation of the system (user interaction determines how the system functions) 
and the fact that Girgensohn states "Any of numerous methods may be used to select an individual 
keyframe from a video clip' 1 (col.6, lines 30-32) one of ordinary skill in the art would make the combination 
of user control and open ended possibility of any numerous method of keyframe selection to yield the 
predictable results of a graphical user interface having the ability to provide to the user a selection of 
keyframe for representation of a video clip or composite. 



As for independent claim 2 , Girgensohn teaches an image processing system for correlating still 
picture data with video data, comprising: a registered client (col.3, line 17; of course those skilled in the 
art would recognize that a registered client could be numerous things, such things as a user logged into a 
personal computer, which is disclosed and reasonably interrupted), including a video display section for 
reproducing and displaying the video data on a screen, a picture display section for reproducing and 
displaying plural pieces of still picture data on the screen (figure 1), wherein the plural pieces of still 
picture data are extracted from the video data and displayed in different sizes, a designation section for 
accepting, during the reproduction of the video data, an instruction from a user to designate one of the 
plural pieces of still picture data displayed on the screen, and a correlation section for, upon the 
instruction entered by the user during the reproduction of the video data, correlating the designated one 
of the plural pieces of still picture data with a reproduction time position in the video data (col.3, lines 17- 
25; col.6, lines 4-17 and col. 7, lines 10-18).; and a distribution server for holding the video data and the 
designated one of the plural pieces of still picture data that are correlated with each other, and in 
accordance with a request from a browsing client, providing the video data and the designated one of the 
plural pieces of still picture data (col. 4, lines 2-6). 
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However, Girgensohn does not specifically and in detail teach a designation section for accepting, during 
the reproduction of the video data, an instruction from a user to designate one of the plural pieces of still 
picture data displayed on the screen. It would have been obvious to one of ordinary skill in the art at the 
time of the invention to have the user select a one of the plural pieces of still picture data from a video clip 
for representation of said video clip, in view of Girgensohn because Girgensohn suggest that the user is 
in control of the presentation, in such that the user manipulates the display as the user sees fit (col. 3, 
lines 39-40). Girgensohn also goes further by explaining the use of still picture data to be used to 
represent video clips and that the still picture data is defined as "keyframes", in such that keyframes are 
selected from the video clips or composites to be representative of the object (video clip). Girgensohn 
provides a few examples of how the keyframes are selected: "keyframes are selected according to a 
variety of criteria. In an embodiment, a keyframe is selected from each video clip or composite. In an 
alternate embodiment, keyframes are selected from the first and last video clips in the sequence." (col. 6, 
lines 18-32) Given the multiple choices of how keyframes are chosen and the fact that the user is a great 
influence over the final presentation of the system (user interaction determines how the system functions) 
and the fact that Girgensohn states "Any of numerous methods may be used to select an individual 
keyframe from a video clip" (col.6, lines 30-32) one of ordinary skill in the art would make the combination 
of user control and open ended possibility of any numerous method of keyframe selection to yield the 
predictable results of a graphical user interface having the ability to provide to the user a selection of 
keyframe for representation of a video clip or composite. 



As for dependent claim 3, Girgensohn teaches an image processing system according to claim 2, 

wherein the distribution server distributes, to the browsing client, correlation data for video data and still 
picture data, and provides the still picture data requested by the browsing client (col.4, lines 7-14). 
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As for independent claim 5 , Girgensohn teaches an image processing method for correlating still 
picture data with video data, comprising: reproducing and displaying the video data on a screen; and 
reproducing and displaying plural pieces of still picture data on the screen (figure 1), wherein the plural 
pieces of still picture data are extracted from the video data and displayed in different sizes (note the 
analysis of claims 1 and 4 above); and in accordance with an instruction entered by a user during the 
reproduction of the video data to designate one of the plural pieces of displayed still picture data, 
correlating the designated still picture data with a reproduction time position in the video data (col.4, lines 
30-49)! 

However, Girgensohn does not specifically and in detail teach a designation section for accepting, during 
the reproduction of the video data, an instruction from a user to designate one of the plural pieces of still 
picture data displayed on the screen. It would have been obvious to one of ordinary skill in the art at the 
time of the invention to have the user select a one of the plural pieces of still picture data from a video clip 
for representation of said video clip, in view of Girgensohn because Girgensohn suggest that the user is 
in control of the presentation, in such that the user manipulates the display as the user sees fit (col. 3, 
lines 39-40). Girgensohn also goes further by explaining the use of still picture data to be used to 
represent video clips and that the still picture data is defined as "keyframes", in such that keyframes are 
selected from the video clips or composites to be representative of the object (video clip). Girgensohn 
provides a few examples of how the keyframes are selected: "keyframes are selected according to a 
variety of criteria. In an embodiment, a keyframe is selected from each video clip or composite. In an 
alternate embodiment, keyframes are selected from the first and last video clips in the sequence." (col. 6, 
lines 18-32) Given the multiple choices of how keyframes are chosen and the fact that the user is a great 
influence over the final presentation of the system (user interaction determines how the system functions) 
and the fact that Girgensohn states "Any of numerous methods may be used to select an individual 
keyframe from a video clip" (col. 6, lines 30-32) one of ordinary skill in the art would make the combination 
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of user control and open ended possibility of any numerous method of keyframe selection to yield the 
predictable results of a graphical user interface having the ability to provide to the user a selection of 
keyframe for representation of a video clip or composite. 

As for independent claim 6 , Girgensohn teaches an image processing method for registering still 

picture data in correlation with video data to a distribution server that provides the video data and the still 
picture data upon reception of a request from a browsing client, the image processing method comprising: 
reproducing and displaying the video data on a screen; reproducing and displaying plural pieces of still 
picture data on the screen, wherein plural pieces of still picture data is extracted from the video data and 
displayed in different sizes; in accordance with an instruction entered by a user during reproduction of the 
video data to describing one of the plural pieces of displayed still picture data correlating the designated 
still picture data with a reproduction time position in the video data (col. 3, lines 17-25; col. 6, lines 4-17 
and col. 7, lines 10-18).; and registering the video data and the still picture data together with correlation 
data to the distribution server (note the analysis of claims 1,2,4). 

However, Girgensohn does not specifically and in detail teach a designation section for accepting, during 
the reproduction of the video data, an instruction from a user to designate one of the plural pieces of still 
picture data displayed on the screen. It would have been obvious to one of ordinary skill in the art at the 
time of the invention to have the user select a one of the plural pieces of still picture data from a video clip 
for representation of said video clip, in view of Girgensohn because Girgensohn suggest that the user is 
in control of the presentation, in such that the user manipulates the display as the user sees fit (col. 3, 
lines 39-40). Girgensohn also goes further by explaining the use of still picture data to be used to 
represent video clips and that the still picture data is defined as "keyframes", in such that keyframes are 
selected from the video clips or composites to be representative of the object (video clip). Girgensohn 
provides a few examples of how the keyframes are selected: "keyframes are selected according to a 
variety of criteria. In an embodiment, a keyframe is selected from each video clip or composite. In an 
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alternate embodiment, keyframes are selected from the first and last video clips in the sequence." (col.6, 
lines 18-32) Given the multiple choices of how keyframes are chosen and the fact that the user is a great 
influence over the final presentation of the system (user interaction determines how the system functions) 
and the fact that Girgensohn states "Any of numerous methods may be used to select an individual 
keyframe from a video clip" (col.6, lines 30-32) one of ordinary skill in the art would make the combination 
of user control and open ended possibility of any numerous method of keyframe selection to yield the 
predictable results of a graphical user interface having the ability to provide to the user a selection of 
keyframe for representation of a video clip or composite. 



As for dependent claim 7, Girgensohn teaches the image processing method according to claim 6, 
wherein the correlation data is a program for requesting the distribution server predetermined still picture 
data in accordance with the reproduction time position in video data, in accordance with a request from a 
browsing client, the distribution server provides video data and the program for the browsing client, and 
the browsing client executes the program as the video data are reproduced, and requests the distribution 
server still picture data that are correlated with the reproduction time position (note the analysis of claim 
2; wherein the use of a network to serve and store video composites, data files , etc). 

As for independent claim 8 , Girgensohn teaches a computer-readable recording medium that stores 
a program that permits a computer to perform an image process for correlating still picture data with video 
data, the process comprising: displaying plural pieces of still picture data on a screen, wherein the still 
plural pieces of still picture data are extracted from the video data and displayed in different sizes; 
accepting an instruction from a user to designate one of the plural pieces of displayed picture data during 
reproduction of the video data, and in accordance with eh instruction entered by the use during the 
reproduction of ht video data to designate the one of the plural pieces of displayed still picture data, 
correlating the designated still picture data with a reproduction time position in the video data (note the 
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analysis of claims 1,2,4,5). 

However, Girgensohn does not specifically and in detail teach a designation section for accepting, during 
the reproduction of the video data, an instruction from a user to designate one of the plural pieces of still 
picture data displayed on the screen. It would have been obvious to one of ordinary skill in the art at the 
time of the invention to have the user select a one of the plural pieces of still picture data from a video clip 
for representation of said video clip, in view of Girgensohn because Girgensohn suggest that the user is 
in control of the presentation, in such that the user manipulates the display as the user sees fit (col. 3, 
lines 39-40). Girgensohn also goes further by explaining the use of still picture data to be used to 
represent video clips and that the still picture data is defined as "keyframes", in such that keyframes are 
selected from the video clips or composites to be representative of the object (video clip). Girgensohn 
provides a few examples of how the keyframes are selected: "keyframes are selected according to a 
variety of criteria. In an embodiment, a keyframe is selected from each video clip or composite. In an 
alternate embodiment, keyframes are selected from the first and last video clips in the sequence." (col. 6, 
lines 18-32) Given the multiple choices of how keyframes are chosen and the fact that the user is a great 
influence over the final presentation of the system (user interaction determines how the system functions) 
and the fact that Girgensohn states "Any of numerous methods may be used to select an individual 
keyframe from a video clip" (col.6, lines 30-32) one of ordinary skill in the art would make the combination 
of user control and open ended possibility of any numerous method of keyframe selection to yield the 
predictable results of a graphical user interface having the ability to provide to the user a selection of 
keyframe for representation of a video clip or composite. 

As for dependent claim 9, Girgensohn teaches an image processing system according to claim 1, 

wherein the different sizes are based on the time length of the corresponding section of the video data 
(col.2, lines 45-47). 
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As for dependent claim 10, Girgensohn teaches an image processing system according to claim 1, 

wherein the different sizes are based on the importance level of the corresponding section of the video 
data (col.2, lines 45-47). 

As for dependent claim 11, Girgensohn teaches an image processing system according to claim 2, 

wherein the different sizes are based on the time length of the corresponding section of the video data 
(col.2, lines 45-47). 

As for dependent claim 12, Girgensohn teaches an image processing system according to claim 2, 

wherein the different sizes are based on the importance level of the corresponding section of the video 
data (col.2, lines 45-47). 

As for dependent claim 15, Girgensohn teaches an image processing method according to claim 5, 

wherein the different sizes are based on the time length of the corresponding section of the video data 
(col.2, lines 45-47). 

As for dependent claim 16, Girgensohn teaches an image processing method according to claim 5, 

wherein the different sizes are based on the importance level of the corresponding section of the video 
data (col.2, lines 45-47). 

As for dependent claim 17, Girgensohn teaches an image processing method according to claim 6, 

wherein the different sizes are based on the time length of the corresponding section of the video data 
(col.2, lines 45-47). 
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As for dependent claim 18, Girgensohn teaches an image processing method according to claim 6, 

wherein the different sizes are based on the importance level of the corresponding section of the video 
data (col.2, lines 45-47). 

As for dependent claim 19, Girgensohn teaches a recording medium according to claim 8, wherein the 

different sizes are based on the importance level of the corresponding section of the video data (col.2, 
lines 45-47). 

As for dependent claim 20, Girgensohn teaches a recording medium according to claim 8, wherein the 

different sizes are based on the time length of the corresponding section of the video data (col.2, lines 45- 
47). 

As for dependent claims 21-25, Girgensohn teaches an image processing system and corresponding 
method and medium according to claims 1,2,5,6 and 8, further comprising a single interface screen that 
includes the video display section, the picture display section , the designation section, and the 
correlation section (note the analysis of claim 1 above). 



(Note:) It is noted that any citation to specific, pages, columns, lines, or figures in the prior art references and 

any interpretation of the references should not be considered to be limiting in any way. A reference is relevant for all it 
contains and may be relied upon for all that it would have reasonably suggested to one having ordinary skill in the art. In 
re Heck, 699 F.2d 1331, 1332-33, 216 USPQ 1038, 1039 (Fed. Cir. 1983) (quoting In re Lemelson, 397 F.2d 1006,1009, 158 
USPQ 275, 277 (CCPA 1968)). 

Response to Arguments 

Applicant's arguments with respect to claim1-3, 5-12 and 15-25 have been 



considered but are moot in view of the new ground(s) of rejection. 
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Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Inquires 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Nicholas Augustine whose telephone number is 571- 
270-1056. The examiner can normally be reached on Monday - Friday: 7:30- 5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Weilun Lo can be reached on 571-272-4847. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 




